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Abstract 

Background and Objective: Despite the availability of clinical practice guidelines (CPGs) for therapeutic drug monitoring 
(TDM) of vancomycin, vancomycin serum concentrations still do not reach therapeutic concentrations in many patients. 
Thus, we sought to systematically review the quality and consistency of recommendations for an international cohort of 
CPGs regarding vancomycin TDIVl. 

Methods: PubMed, Embase, guidelines' websites and Google were searched for CPGs for vancomycin TDM. Two 
independent assessors rated the quality of each CPG using the Appraisal of Guidelines for Research & Evaluation II (AGREEII) 
instrument and data were independently extracted. 

Results: Jwe\ve guidelines were evaluated and the overall quality of guidelines for vancomycin TDM was moderate. The 
highest score was recorded in the domain of clarity of presentation, and the lowest score was recorded in the domain of 
rigor of development and stakeholder involvement. The specific recommendations for vancomycin TDM were moderately 
consistent and guidelines varied in trough concentration monitoring, frequency of TDM, and serum concentration targets. 

Conclusion: The overall guideline quality for vancomycin TDM was not optimal and effort is needed to improve guideline 
quality, especially in the domain of rigor of development and stakeholder involvement. 
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Introduction 

Vancomycin is a first-line therapy for methicillin-resistant 
Staphyhcoccus aureus (MRSA) [1] and this drug is recommended 
for therapeutic drug monitoring (TDM) to minimize the risk of 
nephrotoxicity and to ensure successful therapeutic outcomes [2] . 
To improve the quality of vancomycin TDM, several organiza- 
tions have developed clinical practice guidelines (CPGs) for 
appropriate vancomycin TDM. More patients have appropriate 
trough concentration measurement and sample timing when the 
guideline is followed [,3]. However, many studies suggest that 
significant numbers of patients do not achieve therapeutic 
vancomycin serum concentrations [4—13]. 

CPGs are "statements that include recommendations intended 
to optimize patient care. They are informed by a systematic review 
of evidence and an assessment of the benefits and harms of 
alternative care option" [14]. Properly developed, high quality 
CPGs should offer better patient outcomes, reduce risk, and allow 
cost-effective clinical care [15,16]. However, many CPGs offer 
poor quality, highly variable recommendations [17-21]. To our 
knowledge, a systematic evaluation of the quality and the 
consistency of vancomycin TDM guidelines have not been 
reported. Thus, the objective of this review was to systematically 
evaluate the quality and consistency of recommendations for an 
international cohort of CPGs regarding vancomycin TDM, and in 



an effort to help develop or update vancomycin TDM guidelines 
to achieve higher quality recommendations. 

Methods 

Identification of Guidelines 

Guidelines for vancomycin TDM were identified (until June 25, 
2013) in PubMed and Embase. Search terms included text words 
and Medical Subject Headings (MeSH) terms as follows: 
("guideline" or "practice guideline" or "guidelines" or "practice 
guidelines" or "recommendation" or "consensus review" or 
"guideline" as TopicMeSH) and ("vancomycin" MeSH) and 
("therapeutic drug monitoring" or "TDM" or "drug monitoring" 
or "therapeutic monitoring" or "serum concentration monitoring" 
or "therapeutic drug" or "drug monitoring" MeSH). Guideline 
websites and Google were searched to include more relevant 
CPGs: these included the National Guideline Clearinghouse 
(www.guideline.gov), Guidelines International Network (www. 
g-i-n.net/). National Institute for Health and Clinical Excellence 
(www.nice.org.uk), Scottish Intercollegiate Guidelines Network 
(www.sign.ac.uk) and China Guideline Clearinghouse (cgc. 
bjmu.edu.cn:820/). The search term was "vancomycin" and all 
results were reviewed. Google was searched using the words 
"vancomycin" and "guideline" and the first 100 items were 
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reviewed. To ensure that all potentially relevant guidelines were 
retrieved, we conducted a search by country in Google and no 
language restriction was applied. 

Selection of Guidelines 

CPGs for vancomycin TDM included those that both provided 
practical clinical recommendations and were endorsed by medical 
specialty associations, relevant professional societies or govern- 
mental agencies. Documents l;u king such recommendations and 
secondary publications were excluded. 

Evaluation of Guidelines 

Two assessors (Z.K.Y and C.L) u.sed online training tools 
recommended by the AGREE t:ollaboration before conducting 
appraisals. Two assessors independently scored each guidelines 
using AGREE II [22]. AGREE H consists of 23 items organized 
into six domains: "scope and purpose" (3 items), "stakeholder 
involvement" (3 items), "rigor of development" (8 items), "clarity 
of presentation" (3 items), "applicability" (4 items), and "editorial 
independence" (2 items). Each item is scored from 1 (strongly 
disagree) to 7 (strongly agree). We referred to methods of a 
previous study to resolve discrepancies between the two assessors: 
Briefly, if scores by both assessors differed by two points, they were 
averaged but if they differed by one point, the lower score was 
kept. Next, if scores between assessors varied by three points or 
more, a consensus was reached after a discussion. If consensus was 
not reached, a third person (S.D.Z) participated in the discussion 
and resolved the discrepancy [20]. The standard score of each 
domain was calculated as a percentage of the maximum possible 
score: 

The scaled domain scores = 

(obtained score — minimum possible score) divided by 
(maximum possible score — minimimi possible score) . 

A score of 50% was chosen to estabUsh the proportion of 
guidelines which scored greater than or equal to the level in six 
domains. The overall assessment of included CPGs was based on 
the overall quality of each guideline. 

Synthesis of results 

The included CPGs were summarized according to specific 
recommendations, including indications for TDM, pharmacoki- 
netics-pharmacodynamics, methods of TDM, target of serum 
concentrations and initial administration plan. 

Results 

Study selection 

Figure 1 shows the study selection process for inclusion in this 
review. A total of 635 records were retrieved and after application 
of the inclusion and exclusion criteria, 12 CPGs (AME [23], LOS 
[24], JAP [25], VAN [26], ALB [27], NHS [28], CAL [29], DEV 
[30], COR [31], BAT [32], SAP [33], WOR [34]) were included 
in the review. Table 1 depicts the demographic characteristics for 
included guidelines. Among the twelve CPGs, three (AME, JAP, 
NHS) were national CPGs [23,25,28], and the remaining CPGs 
were regional guidelines. The AME and JAP CPGs were found in 
medical literature databases [23,25], and the others were found by 
Google searches. The AME and JAP CPGs rated the quality of 
evidence and graded the strength of recommendations using the 
classification schemata of the Canadian Medical Association. 



Scope and Purpose 

Table 2 shows the standardized scores of each domain and 
overall recommendation. The mean score for the domain of scope 
and purpose was 63% (range 28-100%). Nine guidelines scored 
greater tiian or equal to 50% [23,25-27,29-31,33,34], two of 
them scored greater than or equal to 94% [23,25]. Most guidelines 
clearly specifically described their scope, related clinical questions 
and target populations. 

Stakeholder Involvement 

The mean score for the domain of stakeholder involvement was 

27% (range 6-50%). Only three guidelines scored 50% [23,25,31]. 
No guidehnes appeared to include or consider the views or 
preferences of the target population. Also, members of the 
guidehne development group were not well identified for many 
guidelines. 

Rigor of development 

The mean score for the domain of rigor of development was 
20% (4-73%). Two guidelines scored above 70% [23,25], die 
remaining guidelines scored below 20%. Only the AME CPG 
clearly described the systematic methods for searching evidence 
[23] and the JAP CPG clearly described the procedure of updating 
the guideUne [25]. No guideline reported their recommendations 
on an underlying systematic review. 

Clarity of presentation 

The mean score for the domain of clarity of presentation was 
77%. All CPGs scored above 50%. Three CPGs scored greater 
than 90% [23,25,27]. Most guidelines presented specific, easily 
identified recommendations for the management of vancomycin 
TDM. 

Applicability 

The mean score for the domain of applicability was 4:7% (range 
38-54%). Only four CPGs scored greater tiian 50% [23,25-27]. 
No guideline considered the cost of vancomycin TDM, and little 
information was offered to describe TDM barriers or facilitators. 

Editorial independence 

The mean score for the editorial independence was 45% 
(25-67%). Four CPGs scored greater than or equal to 50% 
[23,25,31,34]. Only die AME and JAP CPGs reported tiie 
information about competing interests of guideline development 
group members [23,25]. 

Clinical practice guideline recommendations 

Indication of TDM. In Table 3, TDM indication reporting is 
described for die CPGs. Four CPGs QAP, AME, ALB and VAN) 
recommended that TDM should be performed in patients 
receiving aggressive dosing, patients with high risk of nephrotox- 
icit)', unstable renal function, and in those receiving prolonged 
therapy (more than three or five days). Three CPGs (JAP, VAN 
and ALB) specifically recommended that TDM should be 
performed in patients undergoing hemodialysis, those who were 
obese or had low body weight, those with special conditions that 
cause fluctuating volumes of distribution, and in pregnant and 
pediatric patients. The ALB CPG recommended vancomycin 
TDM should be performed in patients with anticipated therapy of 
more than two weeks, and the LOS CPG recommended that 
vancomycin TDM should be performed in patients receiving more 
than 48 h of vancomycin therapy (Table 3). 
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Records identified 
through databases 
searching (n=252) 



Additional records 
identified through other 
sources (n=383) 



Duplicate records removed (n=153) 



Records screened 
(n=482) 



Records retrieved for fiill 
text (n=34) 



Clinical practice 
guidelines included 
rn-12^ 



Figure 1. Flow chart for the systematic review. 

doi:1 0.1 371/journal.pone.0099044.g001 

Pharmacokinetic and pharmacodynamics monitoring 
(PK-PD) parameters. Three CPGs (JAP, AME and VAN) 
recommended that an area under the curve (AUC)/minimum 
inhibitory concentration (MIC) ratio of more than 400 was 
associated with clinical efficacy of vancomycin therapy. Trough 
concentrations were the best surrogates for AUG. Other CPGs did 
not consider a monitoring parameter associated with clinical 
efficacy (Table 3). 

Peak or trough concentrations. Ten CPGs JAP, AME, 
LOS, ALB, NHS, CAE, DEV, BAT, SAP and WOR) recom- 
mended monitoring trough concentrations or pre-dose levels 
rather than peak serum concentrations. The VAN CPG recom- 
mended monitoring pre- and post-dose concentrations to obtain 
precise- pharmacokinetics for some special patients. The COR 
CPG recommended monitoring peak and trough serum concen- 
trations (Table 3). 



Records excluded through 
screening the titles and 
abstracts (n=448) 



Articles excluded (n=22) 

^ Duplicated or not the latest 

version (n=8) 
^ Not released by 

organizations (n=3) 

Not systematically 

developed (n=ll) 



Time to first sample. Most CPGs recommended obtaining 
the first trough sample at steady state (before the S"^**, 4*, or 5 
dose in patients with normal renal function). The SAP CPG 
recommended monitoring troughs within the 48 h of starting 
therapy. The DEV CPG did not report a time for obtaining the 
first trough (Table 3). 

Frequency of TDM. Five CPGs (AME, JAP, ALB, VAN and 
DEV) recommended weekly monitoring after initial TDM in 
patients with normal renal function, and more frequent follow-up 
trough concentration monitoring was required in patients with 
hemodynamic instability, high-dose vancomycin administration, 
unstable renal function, and those at high risk for nephrotoxicity. 
The LOS CPG recommended more frequent monitoring 
in patients with complicated infections (goal trough was 
15-20 |tg/mL) or those with longer courses of therapy. Other 
CPGs recommended additional drug concentration measurements 
4 days or less for patients with normal renal function, and 
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Table 2. AGREE II domain-standardized scores for CPGs on vancomycin TDM. 







Guideline 


Scope and 
Purpose (%) 


Stakeholder 
Involvement (%) 


Rigor of 

development (%) 


Clarity and 
presentation (%) 


Applicability (%) 


Editorial 

independence (%) 


Overall 
assessment 


AME 


100 


50 


71 


100 


54 


67 


Recommend 


LOS 


39 


6 


4 


78 


38 


25 


Not recommend 


JAP 


94 


50 


73 


100 


58 


67 


Recommend 


VAN 


89 


33 


13 


78 


54 


42 


Recommend with 
modification 


ALB 


50 


17 


13 


94 


54 


42 


Recommend with 
modification 


NHS 


28 


11 


4 


61 


42 


33 


Not recommend 


CAL 


50 


11 


4 


78 


42 


42 


Not recommend 


DEV 


50 


22 


8 


56 


46 


42 


Not recommend 


COR 


83 


50 


13 


72 


46 


50 


Recommend with 
modification 


BAT 


33 


17 


8 


73 


46 


42 


Not recommend 


WOR 


78 


44 


19 


67 


42 


50 


Recommend with 
modification 


SAP 


56 


17 


6 


72 


46 


42 


Not recommend 


Mean (Range) 63 (28-100) 


27 (6-50) 


20 (4-73) 


77 (56-100) 


47 (38-58) 


45(25-67) 





doi:l 0.1 371 /journal.pone.0099044.t002 



recommended more frequent monitoring for patients with 
unstable renal function, hemodynamic instability, or in patients 
who experienced changes in renal function (Table 3). 

Sample time. Three CPGs JAP, AME and ALB) recom- 
mended a trough sample should be obtained within 30 min prior 
to next dose. The DEV CPG recommended a trough measure- 
ment within 60 min prior to the next dose. Other CPGs did not 
recommend trough sample timing (Table 3). 

The VAN CPG defined a 3 or 24 h post-dose serum 
concentration as a "post levels". The COR CPG recommended 
measuring peak concentrations 1 h after the end of infusion. In 
addition, the JAP CPG did not recommend routine monitoring 
peak concentrations, but if peak concentrations are needed in 
some special circumstances, peak concentrations should be 
measured 1-2 h after the end of infusion. 

Target of serum concentrations in TDM. Only three 
CPGs (ALB, BAT and WOR) recommended that vancomycin 
trough concentrations should be more than 5 |J,g/mL, and most 
CPGs recommended that vancomycin trough concentrations 
should be maintained above 10 |lg/mL to avoid development of 
drug resistance. Most CPGs recommended higher trough 
concentrations in patients with bacterial infections, infective 
endocarditis, osteomyelitis, meningitis and hospital-acquired 
pneumonia, but no CPG recommend trough concentrations 
greater than 20 |J.g/mL. The VAN CPG recommended 15- 
20 |J,g/mL for patients with complicated infections and suggested 
less than 10 |lg/mL for patients with urinary tract infections or 
skin and soft tissue infections not due to MRSA. The ALB CPG 
recommended trough concentrations at 5-20 |J,g/mL. If therapy 
was combined with aminoglycosides, recommended trough 
concentrations were lower than those for patients without 
aminoglycoside combination therapy. The COR CPG recom- 
mended trough concentrations of 10-15 |a.g/mL, and peak 
concentrations of 18-26 |j,g/mL. The VAN CPG recommended 
3 h post vancomycin concentrations of 20-40 |lg/ml (Table 3). 

Initial administration plan. All guidelines recommended 
calculating the vancomycin dose according to renal function. 



Three CPGs JAP, LOS and AME) recommended giving a loading 
dose of 25-30 mg/kg to facilitate rapid attainment of target trough 
concentrations for serious or complicated infections. Four CPGs 
(VAN, NHS, DEV and SAP) recommended prescribing a loading 
dose according to the patients' actual body weight. Five CPGs 
(ALB, CAL, COR, BAT and WOR) did not recommend a loading 
dose (Table 3). 

Overall assessment 

Two CPGs (AME, JAP) were recommended [23,25], and four 
CPGs (VAN, ALB, COR and WOR) were recommended with 
modification [26,27,31,34]. Six CPGs (LOS, NHS, CAL, DEV, 
BAT and SAP) were not recommended. The two CPGs that were 
recommended have a higher score in domain of rigor of 
development and a standard search strategy, and they classified 
the quality of evidence and graded the strength of recommenda- 
tions. The six CPGs that were not recommended scored below 
10% in the domain of rigor of development and the other 
domains' scores was not high. 

Discussion 

To our knowledge, this is the first study to evaluate the quality 
and consistency of vancomycin TDM guidelines; although, CPG 
quality has been investigated in a variety of clinical areas [17—21]. 
We made three important findings: first, the overall guideline 
quality was moderate, and more efforts are needed to improve 
these gvudelines, especially with respect to the domain of rigor of 
development and stakeholder involvement. Second, vancomycin 
TDM guideline recommendations were moderately consistent. 
Third, regional guidelines were of lower quality than national 
guidelines. In the United Kingdom and Canada, national 
guidelines may be of sufficient quality to replace regional 
guidelines of those areas. 

Guidelines consistentiy scored well with respect to clarity and 
presentation, suggesting that this domain may be easier to achieve 
or may be more highly emphasized by guideline developers. The 
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lowest score was recorded in rigor of development, perhaps due to 
the fact that most guidelines did not report the systematic methods 
for evidence searching, and many had poorly described informa- 
tion about selection criteria, evidential strengths and limitations, 
and procedures for updating guidelines. The AME and JAP CPG 
had the highest scores in this domain and all rated the quality of 
evidence and graded the recommendation strength, indicating that 
using a formal system might improve scores for developmental 
rigor. Developmental rigor is closely related to guideline quality 
and guideline developers should pay more attention to this 
domain. The mean score for stakeholder involvement was 27%. 
No guidelines have considered the views and preferences of 
patients or of the public, but patient involvement in decision 
making about care management may improve physician and 
patient guideline adherence and improve clinical outcomes [35]. 

The mean score for applicability was 47%, and only four 
guidelines scored greater than 50% in this area. No guideline 
considered the cost of vancomycin TDM and no guideline 
provided enough evidence to support the necessity of vancomycin 
TDM. Guideline developers did not address potential barriers of 
guideline implementation and this may have contributed to many 
hospitals not monitoring vancomycin serum concentrations and 
many patients not achieving target therapeutic concentrations. 
The mean score for the scope and purpose was 63%, and most 
guidelines described their scope, related clinical questions and 
target populations well. The mean score for editorial indepen- 
dence was 45%. No guidelines described funding sources, 
although they were developed by medical societies. Most 
guidelines did not offer data regarding competing interests among 
guideline development group members. Guideline developers 
should emphasize these points in future studies. 

Specific recommendations of vancomycin TDM guidelines were 
moderately consistent and varied with respect to trough concen- 
tration monitoring, TDM frequency and target serum concentra- 
tions across guidelines, which was possibly attributed to unique 
references for each guideline and only two guidelines (AME, JAP) 
describing their systematic search strategy. Also, few prospective^ or 
randomized trials for vancomycin TDM were available and most 
of the published literature regarding vancomycin monitoring are 
observational studies. 

The AME and JAP CPG rated the quahty of evidence and 
graded rc'commendations using the same classification schemata 
recommended by the Canadian Medical Association. However, 
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